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CLUSTERING DATA INCLUDING THOSE WITH ASYMMETRIC 
RELATIONSHIPS 

Technical Field of Invention: 

This invention relates to clustering data points and its application to text summarization, 
customer profiling for web personalization and product cataloging. 

Background of the invention: 

Clustering plays an important role in knowledge discovery and data rnining, which are very 
useful in varied domains from biology to astronomy, and from medicine to Web mining. 
Traditionally, clustering is done on data sets, where the underlying relation R is defined 
between any two data points in the data set or is defined between any two points in the space 
containing the data points. The relation between two points is by default considered to be 
symmetric. However, there exist many data sets where the relation between any two points 
need not be symmetric. For example, consider a set of English sentences where the relation 
between two sentences reflects closeness of their meaning. Obviously, one sentence may 
subsume the meaning of the other sentence, may be equal to the other sentence in meaning, 
or may not at all relate to the meaning of the other sentence. (One more example of 
asymmetric relation is that between products - ^(electronic toys, batteries) != i?(batteries, 
electronic toys); ^(Levi's jeans, Wrangler jeans) != R( Wrangler jeans, Levi's jeans).) Thus, 
there exist many examples in which the relation is not symmetric and one needs to mine the 
data under such circumstances. 

Text summarization tools work on a single document or a collection documents and 
generate text of shorter length that summarize the input. These summaries are useful in 
knowing the contents of the documents without actually reading the whole documents. This 
may in turn help in judging the relevance of a document or a collection of documents. Most 
of the text summarization methods rank individual blocks of the input text such as sentences, 
and paragraphs, based on different criteria and summarize the text with the highly ranked 
blocks. The number of blocks of text that is output by these methods is either fixed or may be 
specified by the user. The blocks are ranked based on various criteria viz., block's position in 
the document, semantic content of the block, and block's similarity with the entire document. 
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See for example, "US05867164 - Interactive Document Summarization ," "US05638543 - 
Method and apparatus for automatic document summarization," "US05963969 - Document 
abstraction system and method thereof." There are some tools that are specific to the domain 
of documents. They construct a summary by finding the occurrence of certain phrases in the 
document. 

Information retrieval and filtering systems most often work with a set of keywords called a 
dictionary. These keywords are generally obtained from a set of documents related to the 
system's domain of application. The performance of the systems critically depends on the 
selection of keywords and their usage. Organization of the keywords, viz., vocabulary 
organization, involves imposing a hierarchical structure on the keywords. The structure of 
hierarchy is dependent on how the organization is used. There are many uses of organized 
vocabulary. Vocabulary organization can be done such that the keywords corresponding to 
children of a node are conceptually independent yet they are all related to their parent node. 
This kind of organization addresses the problem commonly encountered by information 
systems viz., the one caused due to representing closely related concepts as independent 
concepts fFoltz 1990, Deerwester et. al. 1988, Savia et. al. 1998, Frakes et al. 1992 - Chapter 
9]. In [Foltz 1990, Deerwester et. al. 1988], a set of orthogonal combination of keywords are 
extracted and used for retrieval and filtering. In [Frakes et. al. 1992], a hierarchy is formed 
based on the frequencies and density functions of various keywords. In [Savia et. al. 1998], a 
hierarchy structure on the keywords is assumed and is used for representing user profiles as 
well as documents for information retrieval. The other use of vocabulary organization could 
be to summarize a collection of documents using a hierarchy of keywords that reflect their 
distribution among the documents. 

Arrangement of products in a physical or electronic store crucially decides the comfort of a 
visiting customer in finding the products she needs and hence her future visits to the stores. 
Therefore, products in an ideal physical or electronic store should be arranged such that any 
customer visiting the store finds the products she needs with minimal search effort. 
Designing a store involves arranging various products within the store. Traditionally, store 
design is done by experts who have an understanding of the needs of the customers as well as 
knowledge about all the products in the store. As the number of products and the number of 
customers increase (which is very much true in case of electronic stores), designing a store by 
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an expert becomes difficult The sources of information that can be used to automate the 
designing of a store are the data relating to different attribute values of the products in the 
store and the data on purchase history of the customers. Data mining methods are employed 
to derive association rules between various products in the stores using the customer 
purchase history [Agrawal et. al. 1996, Srikant et. al. 1995], These methods result in 
associations between a subset of products. For example, "people buying wine also buy milk 
and bread." Store designers use these association rules to design a store. These can be 
particularly useful in case of physical stores where it is sufficient to mine the data for some 
major categories of items. In an electronic store, where there is no restriction on the physical 
layout of the store, one can mine for rules containing any number of items and use them to 
design the store. One of the embodiments of the present invention can be used to 
automatically generate a hierarchy of important products in a store and thus design the store 
at an item level rather than product category level. Apart from designing the stores, these 
hierarchies are useful also in analyzing the key selling items in the store. Store design can 
also be done using various attributes of the products in the store. To automatically find a 
hierarchy of products based on this data, one needs to know the similarity or dissimilarity 
between any two products in the store. Typically, these similarity relations are asymmetric. 

The objects and summary of invention: 

The object of this invention is clustering data points wherein the relationship between the 
data points is symmetric or asymmetric. 

Further, object of the invention is summarizing a single or a collection of documents. 

Another object of the present invention is to provide vocabulary organization, construction of 
summary for a single document or a collection of documents and customer profiling. 

Yet another object of the invention is store designing, and customer segmentation. 

The present invention formulates the problem of clustering a data set under a relation that is 
asymmetric, and describes a method to cluster the data under the proposed formulation. The 
clustering problem is posed as the problem of finding minimal number of mutually distinct 
data points such that all the points in the data set are sufficiently close to at least one of the 
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distinct data points, and then, extracting subsets of the data set by associating each distinct 
point with points that are close to it. The method contains two steps. In the first step, the data 
points are evaluated for their ability to lead a cluster. We call this evaluation as the lead value 
of the data point. This evaluation may depend on the underlying relation or may be very 
specific to the data under consideration. The second step consists of actually finding the 
distinct data points and the associated subset given the lead values of the data points and the 
relation. In this invention, we also describe different variants of the invented method that are 
useful in text summarization, vocabulary organization, customer profiling, store design and 
customer segmentation. 

Text summarization method in the present invention can be applied to summarize a single 
document or a collection of documents. The method finds blocks of the input text that are 
distinct and yet capture all the contents of the input. In general, these blocks could be 
sentences, collections of sentences, paragraphs, or subparagraphs. When applied to a 
collection of documents, summaries of individual documents can also be considered as a 
block. The block d, is related to a block dj by a number that reflects inclusion of the meaning 
of a] in the meaning of d f . Lead value of a block is decided by the effective number (detailed 
below) of times each block appears in the collection of blocks. The above mentioned method 
can be applied using the above lead-values and the relation to cluster the collection of blocks. 
The collection of distinct blocks forms a summary of the input text. It may be noted that each 
cluster can further be clustered into sub-clusters to organize the data in a hierarchy and each 
node in the hierarchy is associated with a block that summarizes all the blocks in the node. A 
summary of variable length can be obtained by taking the representative blocks of some of 
the appropriately selected nodes in the hierarchy. 

The objective of vocabulary organization in automatically generated dictionaries is to impose 
a hierarchical structure on the words in the vocabulary indicating term classes. The invented 
method can also be applied to generate such a hierarchy structure on the words. In this case, 
each word represents a data point and a word d, is related to a word 4 by the percentage of 
documents containing dj that also contain d t . The tf*idf (explained in detail below) of a word 
could be its lead value. Another lead value could be the frequency of a word. Using the lead 
value and the mentioned relation, the invented method can organize the words in a hierarchy. 
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One of the embodiments of the invention can be used to form a hierarchy of products that 
meet different objectives using various types of data. The products are considered as data 
points in this context. If the clustering is done using the customer purchase history, the lead 
value of a product could be a combination of different parameters associated with it, for 
example per unit price, per unit profit, and number of items sold. The relation of the product 
d, with the product d } could be the percentage of times customers bought product d } after 
buying product d,. Given one of the above lead values and the above relation, the invented 
method results in a hierarchy of products. Similarly, if the clustering is done using the 
attributes of the products, the lead value of a product could be a combination of different 
parameters associated with it, for example per unit price, and per unit profit. The relation 
could be any that is defined by a user of the system. 

Accordingly, the present invention provides a method for clustering data points with defined 
quantified relationships between them comprising the steps of: 

obtaining lead value for each data point either by deriving from said 

quantified relationships or as given input, 

ranking each data point in a lead value sequence list in descending order of 
lead value, 

assigning the first data point in said lead value sequence list as the leader of 
the first cluster, and 

considering each subsequent data point in said lead value sequence list as a 
leader of a new cluster if its relationship with the leaders of each of the 
previous clusters is less than a defined threshold value or as a member of one 
or more clusters where its relationship with the cluster leader is more than or 
equal to said threshold value. 

The said relationships between data points are symmetric or asymmetric. 

The lead value of each data point is determined by taking the sum of relation values of each 
of the other data points to said data point. 

The said threshold value is adaptively found for a given number of clusters. 
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A method for organizing a set of data points into an hierarchy of clusters wherein the above 
method is first used to cluster the data points into sets of small sizes, each smaller set is 
further subclustered using the method and subclustering is repeated until a terminating 
condition is reached. 

The above method is applied to text summarization of a single document or a collection of 
documents comprising the steps of: 

segmenting the given input text into blocks such as sentences, a collection of 

sentences, paragraphs, 

excluding words belonging to a defined list of 'stop' words, 

replacing words by their unique synonymous word, if it exists, from a given a 

collection of synonyms, 

application of stemming algorithms for mapping words to root words, 
representing the resulting blocks of text, with respect to a dictionary which is 
either given or computed from the input text, by a binary vector of size equal 
to the number of words in the dictionary whose rth element is 1 if rth word in 
the dictionary is present in the block, 

computing the relationship between any data points di and dj by evaluating 
R(di,dj) = |dj.Tdi|/jdj| wherein T is a thesaurus matrix whose z/th element 
reflects the extent of inclusion of meaning of y'th word in the meaning of rth 
word, and 

clustering the data points wherein the lead value of each data point is 
determined by taking the sum of relation values of each of the other data 
points to said data point, the threshold value is adaptively found for a given 
number of clusters and the set of leaders of the resulting clusters summarize 
the given text. 

The said dictionary is computed by taking the fraction of words, excluding the stop words, 
with highest tfidf value, which is given by: 
tfidf(w/) = tfi * \og(N/dfi) 

where tfidf(w/) is the lead value of data point wi, tfi = the number of times the data 
point wi occurred in the whole text, dfx = the number of documents containing the 
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data point wi and N = the total number of documents in the text. 

The said thesaurus matrix is either a given, identity matrix or computed from a collection of 
documents. 

Each block is represented by a vector whose /th element represents the frequency of 
occurrence of rth word in the block. 

A method for organizing a set of text documents into an hierarchy of clusters wherein the 
above method is first used to cluster the given documents into sets of small sizes, each 
smaller set is further subclustered using the method and subclustering is repeated until a 
terminating condition is reached. 

The above method is also applied to organize the results returned by any information retrieval 
system in response to a user query into an hierarchy of clusters. 

The hierarchy is used to aid the user in modifying his/her query and/or in browsing through 
the results. 

The information retrieval system is any search engine retrieving Web documents. 

The above method is applied to vocabulary organization for a group of documents wherein 
the data points are the words in the dictionary of the vocabulary, the lead value of a word is 
either its frequency of occurrence in the collection, the number of documents containing the 
word or its tfidf value, the relationship R(di,dj) denotes the fraction of documents containing 
the y'th word that also contain rth word, and the clustering produced by the application of the 
method results in a structured hierarchical organization of the vocabulary. 

The structured vocabulary is used to provide text summarization for the associated 
documents. 

The above method is applied to customer profiling wherein the dictionary is built and the 
vocabulary is organized using the documents that are viewed by the customer. 
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The data points correspond to the products cataloged in the store, the lead value of a product 
is its per unit profit, its per unit value or the number of items sold per unit time, and the 
relationship between the products is either explicitly defined or derived from the purchase 
data. 

The product di is related to the product dj by the fraction of customer transactions containing 
dj that also contain di. 

The above method is applied to analyze sales of a store for the merchant or to organize the 
layout of the store to facilitate easy access to products. 

The above method is further applied to personalize the electronic store layout to an 
individual customer by using the relationship that is specific to the customer. 

The above method is also applied to customer segmentation for a sales or service 
organization wherein the data points are the customers in the data base, the lead values are 
their total purchase amount per unit time, their income, the number of times customers 
visited the store, or the number items bought by the customer, the relationship between 
customers is either explicitly defined or derived from some relevant data, with the resulting 
clustering reflecting a structured grouping of customers with similar performances. 

The customer di is related to the customer dj by the fraction of products bought by dj that are 
also bought by di. 

The present invention further provides a system for clustering data points with defined 
quantified relationships between them comprising: 

means for obtaining lead value for each data point either by deriving from said 

quantified relationships or as given input, 

means for ranking each data point in a lead value sequence list in descending 
order of lead value, 

means for assigning the first data point in said lead value sequence list as the 
leader of the first cluster, and 
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means for considering each subsequent data point in said lead value sequence 
list as a leader of a new cluster if its relationship with the leaders of each of 
the previous clusters is less than a defined threshold value or as a member of 
one or more clusters where its relationship with the cluster leader is more than 
or equal to said threshold value. 

The said relationships between data points are symmetric or asymmetric. 

The means for obtaining lead value of each data point is by taking the sum of relation values 
of each of the other data points to said data point. 

The said threshold value is adaptively found for a given number of clusters. 

The above system for organizing a set of data points into a hierarchy of clusters wherein the 
above system is first used to cluster the data points into sets of small sizes, each smaller set is 
further subclustered using the system and subclustering is repeated until a terminating 
condition is reached. 

The above system is used for text summarization of a single document or a collection of 
documents comprising: 

means for segmenting the given input text into blocks such as sentences, a 

collection of sentences, paragraphs, 

means for excluding words belonging to a defined list of 'stop' words, 
means for replacing words by their unique synonymous word, if it exists, from 
a given collection of synonyms, 

means for applying stemming algorithms for mapping words to root words 
means for representing the resulting blocks of text, with respect to a dictionary 
which is either given or computed from the input text, by a binary vector of 
size equal to the number of words in the dictionary whose rth element is 1 if 
rth word in the dictionary is present in the block, 

means for computing the relationship between any data points di and dj by 
evaluating R(di,dj) = |dj.Tdi|/|dj| wherein T is a thesaurus matrix whose z/th 
element reflects the extent of inclusion of meaning of /th word in the meaning 
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of rth word, and 

means for clustering the data points wherein the lead value of each data point 
is determined by taking the sum of relation values of each of the other data 
points to said data point, the threshold value is adaptively found for a given 
number of clusters and the set of leaders of the resulting clusters summarize 
the given text. 

The said dictionary is computed by taking the fraction of words, excluding the stop words, 
with highest tfidf value, which is given by means of: 

where tfidf(wO is the lead value of data point wi, = the number of times the data 
point wi occurred in the whole text, dfi = the number of documents containing the 
data point wi and N = the total number of documents in the text. 

The said thesaurus matrix is either a given identity matrix or computed from a collection of 
documents. 

Each block is represented by a vector means whose ith element represents the frequency of 
occurrence of ith word in the block. 

A system for organizing a set of text documents into a hierarchy of clusters wherein the 
above system is first used to cluster the given documents into sets of small sizes, each smaller 
set is further subclustered using the system and the subclustering is repeated until a 
terminating condition is reached. 

The above system is used to organize the results returned by any information retrieval system 
in response to an user query into an hierarchy of clusters. 

The hierarchy of clusters is used to aid the user in modifying his/her query and/or in browsing 
through the results. 

The information retrieval system is any search engine retrieving Web documents. 
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The above system is used for vocabulary organization for a group of documents wherein the 
data points are the words in the dictionary of the vocabulary, the lead value of a word is 
either its frequency of occurrence in the collection, the number of documents containing the 
word or its tfidf value, the relationship R(di,dj) denote the fraction of documents containing 
the yth word that also contain rth word, and the clustering produced by the system results in a 
structured hierarchical organization of the vocabulary. 

The structured vocabulary organization is used to provide text summarization for the 
associated documents. 

The above system is used for customer profiling wherein the dictionary is built and the 
vocabulary is organized using the documents that are viewed by the customer. 

The data points correspond to the products cataloged in the store, the lead value of a product 
is its per unit profit, its per unit value or the number of items sold per unit time, the 
relationship between the products is either explicitly defined or derived from the purchase 
data. 

The product di is related to the product dj by the fraction of customer transactions containing 
dj that also contain di. 

The above system is used for analyzing sales of a store for the merchant or for organizing the 
layout of the store to facilitate easy access to products. 

The above system is further used to personalize the electronic store layout to an individual 
customer by using the relationship that is specific to the customer. 

The said system is used for customer segmentation for a sales or service organization wherein 
the data points are the customers in the data base, the lead values are their total purchase 
amount per unit time, their income, the number of times customers visited the store, or the 
number items bought by the customer, the relationship between customers is either explicitly 
defined or derived from some relevant data, with the resulting clustering reflecting a 
structured grouping of customers with similar performances. 
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The customer di is related to the customer dj by the fraction of products bought by dj that are 
also bought by di. 

The instant invention further provides a computer program product comprising computer 
readable program code stored on computer readable storage medium embodied therein for 
clustering data points with defined quantified relationships between them, comprising: 

computer readable program code means configured for obtaining lead value 
for each data point either by deriving from said quantified relationships or as 
given input, 

computer readable program code means configured for ranking each data 
point in a lead value sequence list in descending order of lead value, 
computer readable program code means configured for assigning the first data 
point in said lead value sequence list as the leader of the first cluster, and 
computer readable program code means configured for considering each 
subsequent data point in said lead value sequence list as a leader of a new 
cluster if its relationship with the leaders of each of the previous clusters is 
less than a defined threshold value or as a member of one or more clusters 
where its relationship with the cluster leader is more than or equal to said 
threshold value. 

The said relationships between data points are symmetric or asymmetric. 

The said computer readable program code means configured for obtaining lead value of each 
data point is by taking the sum of relation values of each of the other data points to said data 
point. 

The said threshold value is adaptively found for a given number of clusters. 

A computer program product for organizing a set of data points into an hierarchy of clusters 
wherein above computer program product is first used to cluster the data points into sets of 
small sizes, each smaller set is further subclustered using the computer program product and 
the subclustering is repeated until a terminating condition is reached. 
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The above computer program product is configured for text summarization of a single 

document or a collection of documents comprising: 

computer readable program code means configured for segmenting the given 
input text into blocks such as sentences, a collection of sentences, paragraphs, 
computer readable program code means configured for excluding words 
elonging to a defined list of 'stop' words, 

computer readable program code means configured for replacing words by 
their unique synonymous word, if it exists, from a given a collection of 
synonyms, 

computer readable program code means configured for applying stemming 
algorithms for mapping words to root words, 

computer readable program code means configured for representing the 
resulting blocks of text, with respect to a dictionary which is either given or 
computed from the input text, by a binary vector of size equal to the number 
of words in the dictionary whose rth element is 1 if rth word in the dictionary 
is present in the block, 

computer readable program code means configured for computing the 
relationship between any data points di and dj by evaluating R(di,dj) = 
|dj.Tdi|/|dj| wherein T is a thesaurus matrix whose ijth element reflects the 
extent of inclusion of meaning of yth word in the meaning of rth word, and 
computer readable program code means for clustering the data points wherein 
the lead value of each data point is determined by taking the sum of relation 
values of each of the other data points to said data point, the threshold value is 
adaptively found for a given number of clusters and the set of leaders of the 
resulting clusters summarize the given text. 

The said dictionary is computed by taking the fraction of words, excluding the stop words, 
with highest tfidf value which is given by: 
tfidf(wO = tfi * log(N/ dfi) 

where tfidf(wz) is the lead value of data point wi, tfi = the number of times the data 
point wi occurred in the whole text, dfi = the number of documents containing the 
data point wi and N = the total number of documents in the text. 
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The said thesaurus matrix is either a given identity matrix or computed from a collection of 
documents. 

Each block is represented by a vector computer readable program code means, whose rth 
element represent the frequency of occurrence of rth word in the block. 

The above computer program product for organizing a set of text documents into a hierarchy 
of clusters wherein the above computer program product is first used to cluster the given 
documents into sets of small sizes, each smaller set is further subclustered using the 
computer program product and the subclustering is repeated until a terminating condition is 
reached. 

The above computer program product is configured for organizing the results returned by any 
information retrieval system in response to an user query into an hierarchy of clusters. 

The hierarchy of clusters is used to aid the user in modifying his/her query and/or in browsing 
through the results. 

The information retrieval system is any search engine retrieving Web documents. 

The above computer program product is configured for vocabulary organization for a group 
of documents wherein the data points are the words in the dictionary of the vocabulary, the 
lead value of a word is either its frequency of occurrence in the collection, the number of 
documents containing the word or its tfidf value, the relationship R(di,dj) denote the fraction 
of documents containing the j'th word that also contain rth word, and the clustering produced 
by the computer readable program code means results in a structured hierarchical 
organization of the vocabulary. 

The structured vocabulary organization is used to provide text summarization for the 
associated documents. 

The said computer program product is configured for customer profiling wherein the 
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dictionary is built and the vocabulary is organized using the documents that viewed by the 
customer. 

The data points correspond to the products cataloged in the store, the lead value of a product 
is its per unit profit, its per unit value or the number of items sold per unit time, the 
relationship between the products is either explicitly defined or derived from the purchase 
data. 

The product di is related to the product dj by the fraction of customer transactions containing 
dj that also contain di. 

The above computer program product is configured for analyzing sales of a store for the 
merchant or for organizing the layout of the store to facilitate easy access to products. 

The said computer program product is also configured for persomlizing the electronic store 
layout to an individual customer by using the relationship that is specific to the customer. 

The said computer program product is further configured for customer segmentation for a 
sales or service organization wherein the data points are the customers in the data base, the 
lead values are their total purchase amount per unit time, their income, the number of times 
customers visited the store, or the number items bought by the customer, the relationships 
between customers is either explicitly defined or derived from some relevant data, with the 
resulting clustering reflecting a structured grouping of customers with similar performances. 

The customer di is related to the customer dj by the fraction of products bought by dj that are 
also bought by di. 

Brief Description of the Drawings: 

The invention will now be described with reference to the accompanying drawings. 

Figure 1 shows the weighted directed graph of example 1. 

Figure 2 shows schematic diagram of the method, according to this invention. 
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Figure 3 shows the resultant graph after the method is applied to the data in example 1 . 
Figure 4 shows the schematic diagram of converting test blocks to binary vectors. 
Figure 5 shows user interaction with clusters of web results 
Figure 6 shows dialog-based navigation through a collection of documents 
Detailed Description of the drawings: 

We first precisely define the problem under consideration before explaining the method and 
its variants. We will also describe embodiments of these variants of the invented method. 

Problem Definition: Given a data set D = {d t , d 2> ... d N }, a relation R.DxD [0,1], and a 

number r\, the objective is to find a subset SofD satisfying the following: 

1. l.Each element s t e S is associated with a set G, such that 4 e G if R(dj,s t ) <tj, 

2.2. for all d h min, R(dj,Si) < t], 

3. 3. s t are as distinct as possible, and 

4.4. the cardinality of S is as small as possible. 

One can build a hierarchy, H, on D by clustering the sets C, further. 

Weighted Directed Graph of a Relation (shown in fig. 1): Let D = {d u d 2 ,... d N } be the data 
set and R be a relation on D. The weighted directed graph (WDG) associated with the 
relation R is the graph in which the vertices represent d t and the edge from d, to d, has weight 
R(d t ,dj). In case of multiple instances of same data point in D, the above graph contains 
vertices corresponding to unique points in D and each vertex is associated with the frequency 
of the data point in D. Without loss of generality, let D represent the set of unique data points 
and^ be the frequency of d t . 

Example 1: Let D contain six elements each with frequency one and let R be represented as 
in the following matrix. 
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1.0 0.8 0.0 0.0 0.0 0.3 
0.25 1.0 0.2 0.0 0.0 0.0 
0.0 0.85 1.0 0.2 0.0 0.0 
0.0 0.0 0.3 1.0 0.4 0.9 
0.0 0.0 0.0 0.5 1.0 0.8 

0. 0 0.25 0.0 0.0 0.3 1.0 

The associated graph is shown in Fig. 1 . 

The Method: The method schematically presented in Fig. 2. The method first computes the 
lead values of data points. The lead value of each data point may depend on the underlying 
relation or may be very specific to the data under consideration. In general, the sum of 
relation values of each of the other data points to the data point, viz. the in-degree of the 
corresponding vertex may be a good lead value. 

The method identifies the distinct data points based using these lead values and the 
underlying relation. The set of distinct points S, is built by considering the data points in the 
descending order of their lead values. The first point in the order is added to S. Then, the next 
point is added to S if none of the points already in <S are close to the point. A pseudo-code for 
the method is given below. 

Pseudo-code: 

1 . Compute the lead value of each data point in D. 

2. Sort data points in the decreasing order of their lead values. Let the sorted index set / = 
{nl, n2, nN). 

3. Initialize 5. Let A be an array of vectors of variable length. The first element in each 
vector represents the index of an element in S and the rest of the vector represents indices 
of elements in Q. Denote rth elements of A by a, and / the element of S by sj. Let A = 
[(nl)l S = { Sl }={d nl }, and i = 2. 

4. BuildS. 

while i<N,{ 
isLeader = true; 
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for j = 1 to \S\,{ II \S\ - cardinality of S 
if (R(d m -,s j )<? 7 ){ 
a } — {a.j , ni); 
isLeader = false; 

} 

} 

if (isLeader) { 

A = [A£ni)}; 

S = SU {d ni }; 

} 

i = i+ 1; 

} 

Example 1 (Continued): Fig. 3 shows the cluster obtained by applying the above method on 
Example 1 for tj = 0.5. Lead Values for d u d 2 , and d 6 are 1.25, 2.9, 1.5, 1.7, 1.7, and 2.7, 
respectively. Therefore, the first distinct element is d 2 , i.e., S = {d 2 }. Then, since R(d 6 ,d 2 ) < 
0.5, S = {d 2 ,d 6 }. Since for i = 1, 3, 4, and 5, d, is closer than 0.5 to either d 2 or d 6 , S = {d 2 ,d 6 }, 
d = {2, 1, 3} and G = {6, 4, 5}. 

Text Summarization: A variant of the above method can be used for text summarization. 
This variant segments the input text into blocks and finds a set of blocks that are mutually 
distinct in terms of their content and yet cover the contents of the entire text, thus producing 
a summary of the input. Each block could be a sentence, a collection of sentences, a 
paragraph, or a collection of paragraphs. The method processes each block and represents it 
in a uniform way. This processing contains several steps and uses a dictionary of words. The 
dictionary of words could be either prefixed or built from the input text. There are several 
ways to build a dictionary [Frakes et. al. 1992, Salton et. al. 1983]. One of the ways to build a 
dictionary for a given collection of documents is to consider the top K number of words with 
highest tPidf value, where K is a fixed number and tf*idf is defined as: 

tPidrT^) = tf t * log(N/dfi). (2) 
In the above equation, tf, is the number of times the word w, occurred in the whole collection, 
df, is the number of documents containing the word w t and N is the total number of 
documents in the collection. 
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The following sequence steps which are schematically shown in Fig. 4 constitutes a way to 
uniformly represent a block by a binary vector for a given dictionary W = {wi, w 2 , . .. , w K } : 

1. Stop words are removed from the blocks. The list of stop words could be 
pre-specified and/or computed using tf*idf value of each keyword. 

2. Given a collection of synonyms, viz., a mapping from many synonymous words to a 
unique word, each word in the block, if it has a synonym, is replaced by its unique 
synonym. 

3. A stemming algorithm is applied to each word to map it to its root word. For example, 
"replicating", and "replicated" are mapped to "replicat." 

4. Finally, the block is represented by a vector of dimension K whose i th element is 1 if 
the block contains w, otherwise it is equal to 0. 

Let AT be the total number of blocks in the input text and D = {di, d 2 , ... d N } represents the set 
of binary vectors associated with the blocks. Now the relation between any two data points 
should reflect the extent of inclusion of meaning of one in the other. To capture this, one 
needs to know the extent of inclusion of meanings of one word in the another word. One can 
use a thesaurus for this purpose. Thesaurai can be constructed manually or automatically 
{Frakes et. al. 1992]. Let Tbe a thesaurus where hj is the extent of meaning of w, included in 
the meaning of w t . If nothing is known about the words, T becomes an identity matrix, 
implying no word is related to any other word. Then, the relation R is defined as follows: 

R(d h dj) = |4. Td t \l\dl (3) 
where \a\ is the element sum of the vector a and a.b is the dot product of a and b. The 
invented text summarization method uses R as defined in (3) along with the lead values as 
defined in (1) to cluster the set D. The method summarizes the contents of the input by the 
blocks corresponding to the data points in the set S resulting from the clustering algorithm 
proposed in this invention. Each block in the summary can be ranked by the in-degree of the 
corresponding data point in D, which reflects an effective number occurrences of the block in 
the input text. 

One embodiment of the above method can be used to cluster Web results where T can be 
either obtained from Wordnet (http://www.wordnet.com) like software or computed from a 
collection of documents. In many cases, search engines over the web return thousands of 



19 



JP920000447US1 



links containing a given query. Going through these many links to discover a relevant one 
would be quite tiresome and many times this may cause the user of a search engine to quit his 
search. Summarization is helpful in solving the above-mentioned problem. Let the set D 
consist of vectors representing the search results. Typically D consists of a titles of Web 
pages and small "snippets" describing the contents of the Web pages, returned by a search 
engine in response to a query. These results are clustered using the invented method resulting 
in S. Since the elements in S reflect the kind of documents each cluster contains, user is 
shown the elements of S. When the user chooses an element from S, then the elements in the 
corresponding d are shown to the user if the number of documents in the cluster is less than 
a preset threshold. Otherwise, this cluster is further sub-clustered and the resulting S is shown 
to the user. This process is schematically shown in Figure 5. 

The above principle can also be used to refine a query submitted to a database of text 
documents. When a user selects an element of S in the interactive navigation, a subset of 
keywords belonging to the cluster corresponding to the selected element of S can be added to 
the query to augment it. The augmented query can be used to obtain to get a set of fresh 
results from the search engine. 

The other application of the invented summarization method is in dialogue based navigation 
through a collection of text documents. One of the ways of searching and/or browsing 
through collection of text documents is through a dialogue based navigation. To start with, 
the collection of text documents is organized in the form of hierarchical clusters based on a 
certain criterion. The organization is done such that documents in a node in the hierarchy are 
related to each other. The user interacts with a navigational system through a dialog. At every 
instance, the user's query is parsed and mapped to a node in the hierarchy and a reflection is 
generated based on the contents of the node. The mapping from the query to a node can be 
based on the content of the present and/or previous queries and/or the node visited in the 
previous instance. For example, the node can be one of the children of the previous node that 
best matches the present query w. r. t. a certain criterion. The invented method can be used to 
generate summaries of each node in the hierarchy. Meaningful reflections are created using 
the summary of the visiting node. The block diagram of the underlying process is shown in 
Figure 6. 



20 



JP920000447US1 



Vocabulary organization in automatically generated thesauri: The objective is to impose a 
hierarchical structure on the words in the vocabulary indicating term classes. Let D be the set 
of words under consideration at the root of the hierarchy. We describe the algorithm using a 
specific embodiment of the invented method. Let R(d h dj) denote the fraction of documents 
containing word d } that also contain d t . Note that R is computed with respect to a given set of 
documents. Let the lead value of word wi (di) be the tf*idf value of wi as given in (2). The 
lead value could also be the frequency of the word's occurrence in the collection of 
documents. Using one of the lead values and the above mentioned R, the invented method 
shown in Figure 2 is applied to cluster the set of words D. Then, the resulting S contains the 
words corresponding to the child nodes of the root. C, now represents a list of words at the 
corresponding child node. Every child node G can be further sub-clustered using the 
documents that contain the word s,. Thus, constructed hierarchy of words imposes an 
organization on the vocabulary. 

When the lead value of a word is the frequency of the word in the collection of documents, 
the resulting hierarchy summarizes the collection of documents reflecting the distribution of 
words among the collection. When the lead value is tf*idf , the resulting hierarchy is such 
that the words corresponding to children of a node are distinct. This hierarchy is very useful 
in information retrieval and filtering when incorporated in representing the documents. 

Customer profiling by a hierarchy of words: Recently, there have been studies that look into 
representing customer profiles as a hierarchy of keywords [Savia et. al. 1998]. If a hierarchy 
of words is constructed based on the documents that an individual has visited then such a 
hierarchy can be used as a profile of the individual and that profile can be used for 
information filtering. Similar user profiles can also be used for generating product 
recommendations if the hierarchies are formed using the descriptions of the products that the 
user has purchased in the past. 

Store design: We describe in detail the use of the invented method in the design of a 
physical or electronic store that meets certain objectives. The invented method can also be 
used to design a store to meet other objectives too, but one needs to modify the lead value 
and the relation appropriately. Let D in the invented method be the set of products. Let the 
problem under consideration be that of finding a hierarchy of products such that the child 
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nodes of a node of the hierarchy represent the key products that are sold in terms of per unit 
profit. Then, the lead value of a product would be its per unit profit and the relation R(d„dJ 
reflects the certainty of customer buying product dj after buying product d,. R(d t ,dJ can be 
estimated from the customer purchase history. If the invented method shown in Figure 2 is 
applied on the product data along with the above defined lead value and R, the resulting set S 
represents the set of key products in the store and the corresponding C, contain the auxiliary 
products. The method can in turn be applied to each of the C, to further sub-cluster them. 
This process of sub-clustering can be continued till the clusters contain fewer than a 
pre-specified number of products. 

A hierarchy of products can also be obtained from the detailed data on the products using the 
invented method. Even in this case, the lead value of each product is its unit price. We may 
assume that the relation between pairs of products is given, which is either explicitly defined 
by a shop designer or derived by a separate module and could be dependent on various 
attributes and features of the products. 

Personalized store design: A personalized catalog of products can be obtained if one uses a 
relation that is specific to the customer and is either explicitly specified by the customer or 
learned from her navigational behavior on the store's Web site. 

Customer segmentation: Here is an embodiment of the invented method to find customer 
segments using customer purchase history. Let D represent the set of customers to be 
segmented. The lead value of a customer could be a combination of the number of times she 
visited the store, money spent by the customer per visit, money spent on products belonging 
to a certain catagory, etc. The relation R(di,dj) is equal to the percentage of products bought 
by dj that have been bought by di. The hierarchy resulting from the application of the 
method shown in Figure 2 would be such that, customers at child nodes of a parent node 
represent a typical set of customers who bought non-overlapping sets of products. 
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